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Abstract. The main objective of this survey is to present the important 
theoretical and experimental results contributed till date in the area of 
online algorithms for the self organizing sequential search problem, also 
popularly known as the List Update Problem(LUP) in a chronological 
way. The survey includes competitiveness results of deterministic and 
randomized online algorithms and complexity results of optimal off line 
algorithms for the list update problem. We also present the results as- 
sociated with list update with look ahead, list update with locality of 
reference and other variants of the list update problem. We investigate 
research issues, explore scope of future work associated with each issue 
so that future researchers can find it useful to work on. 

1 Introduction 

Design of efficient algorithms under the limitations of accessibility of data is a 
real challenging research area in computer science. The traditional design and 
analysis of algorithms assumes that an algorithm generates output with complete 
knowledge of the entire input. However, this assumption is often unrealistic in 
practical applications. Many of the algorithmic problems that arise in real life are 
online in the sense that the input is only partially available and some relevant 
input data arrives in the future being not accessible at present. Online prob- 
lems arise in many areas of computer science such as resource management in 
operating systems, routing in communication networks, paging in virtual mem- 
ory, scheduling and data structures [?]. An online algorithm must generate output 
without knowledge of the entire input. The quality of an online algorithm is usu- 
ally evaluated using an approach called competitive analysis. In this approach, an 
online algorithm for a problem is compared to an optimum off-line algorithm. An 
optimum off-line algorithm knows the entire input sequence in advance and can 
process it with minimum cost. Given an input sequence ct, let ALG(cr) denote 
the cost incurred by online algorithm ALG in processing a and OPT(cr) denote 
the cost incurred by optimal off-line algorithm OPT in processing a. Then the 
algorithm ALG is c- competitive, if there exists a nonnegative constant a such 
that ALG((t) < c.OPT((t) -I- a for all input sequences a. Here c is called the 
Competitive Ratio(CR) of the online algorithm ALG. The competitive ratio is 
always at least 1 and the smaller it is, the better ALG performs with respect to 
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OPT. In computer science, sequential search is a search algorithm for searching a 
list of unsorted data items for a particular value and is one of the; simplest basic 
search method. In sequential search, we start from the beginning of the list, scan 
each item one by one down the list, until the desired item is found or we have 
reached the end of the list. A self organizing sequential search algorithm may 
rearrange the order of the items in the list in some fashion just after an item is 
searched and place the more frequently searched item closer to the front of the 
list to reduce future search times. The self organizing sequential search problem, 
popularly known as the list update problem is of significant practical interest in 
the context of self-organizing data structures. ^eZ/ organizing data structures re- 
organize their structure while processing a sequence of operations. The purpose 
of this reorganization is to guarantee the efficiency of future operations. Self- 
organizing rules are effective because they take advantage of locality of reference 
found in real time systems. 

The list update problem is concerned with maintaining a dictionary as an un- 
sorted linear list. The dictionary is an abstract data type, which is frequently 
used in practice because of its great simplicity. An abstract data type is a set of 
data values and associated operations that are precisely specified independent of 
any particular implementation. When the dictionary is small (such as e.g. orga- 
nizing the list of identifiers maintained by a compiler or organizing collisions in a 
hash table or when there is no space to implement time efficient space consuming 
data structures), linear list is the implementation of choice. An unsorted linear 
list is one of the simplest data structure on which we can perform insertion, 
deletion and access operations. To perform access, the list has to be traversed 
linearly from the start of the list until the requested item is found. The insertion 
operation is performed by adding an item immediately after the last item of the 
list and deletion of an item is performed by simply removing the item from the 
list after accessing the item. 

Problem Statement : Given an unsorted linear list L of 1 distinct items and a fi- 
nite sequence of input requests u of size n, where each request is either an access, 
insert or delete operation on an item in the list. As insert and delete operation 
can be regarded as a special case of access, we can only perform access operation 
and refer the list update problem as the list accessing problem. A request is said 
to be serviced, if we perform a search or access operation of the requested item 
in the list by incurring some access cost. After accessing an item, wc rearrange 
the items in the list by incurring some reorganization cost before the next access. 
Our goal is to minimize the total reorganization and access cost while serving a 
given request sequence cr on a list of size 1. 

Motivation and Applications : List update techniques have been extensively used 
in practice when storing and maintaining small dictionaries. They are also used 
to develop fast and simple algorithms for computing point maxima and convex 
hulls in computational geometry. Another important application of list update 
is for data compression[?] . 

Historical overview of research work : The list update problem is of significant 
theoretical and practical interest for the last four decades. As per our knowl- 
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edge, study of list update techniques was initiated by the pioneering work of 
McCabe [?] in 1965. He investigated the problem of maintaining a sequen- 
tial file and developed two algorithms Move- To-Front (MTF) and Transpose. 
Prom 1965 to 1985, the list update problem was studied by many researchers 
[?,?,?,?,?,?,?,?,?,?] under the assumption that a request sequence is generated 
by a probability distribution. Hester and Hirschberg[?] have provided an exten- 
sive survey of average case analysis such list update algorithms. The seminal 
paper by Sleator and Tarjan[?] in 1985 made the competitive analysis of online 
algorithms very popular. Quite a few of the competitive analysis of the list up- 
date problem were carried out without any specific knowledge of the nature of 
the optimal off-line algorithm. The first use of randomization and the demonstra- 
tion of its advantage in the competitive analysis context was done by Borodin, 
Linial and Saks[?] with respect to metrical task systems in 1987. The first study 
of randomized online algorithms for the list update problem was initiated by 
Irani, Reingold, Westbrook and Sleator[?] in 1990. Teia[?] proved a lower bound 
of 1.5 on the competitive ratio of any randomized online algorithm in 1993. The 
best randomized online algorithms with competitive ratio 1.6 by COMB is due 
to Albers and et. al [?].A detailed study of off-line algorithms for the list update 
problem was published by Westbrook and Reingold[?] in 1996. Ambuhl and et. 
al.[?] proved a more stronger lower bound of 1.50084 for the partial cost model. 
Ambuhl[?] also proved that off-line list update is NP-hard in 2000 by showing a 
reduction from the Minimum Feedback Arc Set Problem. Martinez and Roura[?] 
in 2000 proved that, under a more realistic model no online algorithm including 
MTF can be c-competitive for any constant c. Bachrach and et. al. have pro- 
vided an extensive theoretical and experimental study of online list accessing 
algorithms in 2002 [?]. 

Contributions and Organization of this survey : The aim of this survey is to 
present the theoretical and experimental research work that has been done in 
the area of online algorithms for the self organizing sequential search problem 
also known as the list update problem. In section 2, the standard list update 
cost model, both deterministic and randomized online algorithms and concept 
of adversary is introduced. In section 3 and 4 , we present the well known de- 
terministic and randomized online algorithms for the list update problem with 
competitiveness results. Section 5 includes online algorithms for list update with 
look ahead and section 6 includes online algorithms for list update with locality 
of reference. Various empirical studies are highlighted in section 7 and variants 
of the list update problem are mentioned in section 8. Off-line algorithms for list 
update is covered in section 9. We explore the research directions and investigate 
the scope of future work associated each research issue of the list update prob- 
lem in each of the above sections 3-9. Finally section 10 presents a concluding 
remark. 
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2 Preliminaries 



The list update cost model : This model is a standard cost model defined by 
Sleator and Tarjan. A list L consists of 1 labelled unsorted items. Operations to 
be performed are access, insert and delete. Accessing the item in the list which 
is in i*^ position from the front of the list costs i. If the item is not present in 
the list, then the access cost is 1. Cost of servicing each request for item x is 1 
+ (number of items before x in the list). If x is not present in the list, service 
cost for each request is 1 + 1. Inserting an item costs 1+1. Deleting the i*^ item 
costs i. Free transposition : After item x is accessed or inserted, it is moved to 
any location towards the front of the list with no cost. Paid transposition is the 
exchange in position of adjacent items in the list at a cost of 1. The goal is to 
reorganize the list L by performing free and paid transpositions that minimize 
access and reorganization cost. An algorithm can reorganize the list at any time. 
Reorganization cost is measured by minimum number of transpositions of con- 
secutive items in the list. Static list update model is one in which the number 
of items is fixed in the list and only access operation is performed. Dynamic 
list updaie m,odel is one in which the number of items in the list vary and all 
the three operations such as access, insert and delete can be performed. Until 
unless specified, in this paper we consider the static list update and standard 
cost model. 

List update algorithm : The online list update algorithms can be classified in 
to two types such as deterministic and randomized. A deterministic online al- 
gorithms updates the list based on current and past requests. An adversary, 
often called the off-line player, based on the knowledge of the algorithm used 
by online algorithm tries to make the task costly to the on-line algorithm by 
constructing the worst possible input. An oblivious adversary must construct 
the request sequence in advance and pays optimally to service the request se- 
quence. An adaptive online adversary serves the current request on-line and then 
chooses the next request based on online algorithms action so far. An adaptive 
off-line adversary chooses the next request based on online algorithm's action 
thus far, but pays optimal off-line cost to service the resulting request sequence. 
A randomized strategy is defined by a probability distribution over the set of all 
deterministic strategies. In online randomized algorithm, before serving the first 
request, one of the deterministic strategies is chosen according to probability dis- 
tribution. Let ALG be the randomized algorithm which is online. Based on the 
probability distribution ALG uses, the oblivious adversary must choose a finite 
request sequence a in advance. ALG is c-competitive against an oblivious adver- 
sary, if for every such a, E[ALG(a)] < c.OPTfcr) + a, where a is a constant 
independent of a. Here OPT is not a random variable, hence off-line player does 
not have info about the outcomes of random choices made by online algorithm. 
A randomized on-line algorithm ALG is c-competitive against an adaptive online 
adversary, if there is a constant a such that for all lists and all adversaries. A', 
E[A(a) - c. A'(a)j < a. 
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3 Deterministic online algorithms 

In this section we present sonic well known deterministic online algorithms for 
the list update problem as proposed in the literature. A summary of important 
results is presented in Table 1. 

— Move-To-Front (MTF) : After accessing an item x in the; list, move it to the 
front of the list without changing the order of other items in the list. 

— Transpose (TRANS) : Transpose the accessed item x with the immediately 
preceding item in the list. 

— Frequency Count (FC) : Initialize frequency counter of each item to 0. After 
accessing an item, increment its frequency counter by one. Rearrange the 
items in non-increasing order of their frequencies. 

— MTF2 : Move x to the front of the list, if the position of accessed item x is 
even. 

— MHD(k): Move accessed item x forward k positions in the list. 

— MF(k) : Move accessed item x from its current i*'' position to \ (i/k) ] - 1 
positions towards the front of the list. 

— Time Stamp (TS) : Insert accessed item x in front of the first item y that 
precedes x on the list and was requested at most once since the last request 
for X. Do nothing, if there is no such y, or if x is requested for the first time. 

— Pass-Recent-Item,(m) or PRI(m) : Move accessed item x forward just in front 
of item z on the list that was requested at most m times since the last request 
for X. Do nothing, if there is no such z, or if x is requested for the first time 
in the list. 

— Move-to-Recent-Rem(m) or MRI(m) : Move accessed item x forward just 
after the last item z on the list that is in front of x and has been requested 
at least m+1 times since the last request for x. If there is no such z, move x 
to the front or if x has been requested for the first time, do nothing. 



Algorithm 


Competitiveness Result 


Researcher(s) and Year 


MTF 


2-couii)(>titi\"<' 


Slcator. Tar.jau [?] [1985] 


MTF 


2-2/(1+1): Lower Bound 


Karp, Raghavan 


MTF 


2- 2/{\+l): Upper Bound 


Irani[?] [1991] 


TRANS 


21/3 : Lower Bound 


Sleator, Tarjan [?] [1985] 


FC 


(1-1-1) /2 : Lower Bound 


Slcator, Tarjan [?] [1985] 


MTF2 


2-competitive 


Bachrach, El-Yaniv[?] [1997] 


MF(k) 


2k-competitive 


Sleator, Tarjan [?] [1985] 


TS(0) 


2-competitive 


Albers[?] [1995] 


MRI(k) 


2-competitive 


El-Yaniv[?] [1996] 


PRI(m) 


3-competitive, for m> 1 


Bachrach et. al. [?] [2002] 



Table 1 : Competitiveness of Deterministic Online algorithms 



Research Issues : 

— Define the List update cost model more rigorously to achieve better analysis 
results. 
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— Generation, classification and characterization of different types of request 
sequences tliat can model real world inputs. 

— Determination of optimal deterministic competitive ratio for dynamic list 
update problem. 

— Design of deterministic online algorithms that affect locality of reference for 
real life inputs. 

4 Randomized Online Algorithms 

A number of randomized online algorithms have already been proposed by re- 
searchers for the list update problem. We present some well known algorithms 
in the following section and a summary of results in Table 2. 

— SPLIT : For each item x, maintain a pointer p(x) pointing to some item in 
the list. With probability 1/2, move accessed item x to the front and with 
probability 1/2, insert x in front of p(x). Then set p(x) to the first item in 
the Hst. 

— BIT : For each item x in the list, maintain a mod-2 counter b(x). Initially set 
b(x) to or 1 randomly, independently, uniformly. Then complement b(x). 
If complement of b(x) = 1, move accessed item x to the front of the list. 

— RMTF : With probability 1/2, move the accessed item x to the front. 

— COUNTER(s, S) : For each item x, maintain a mod-s counter c(x)e {0, 1, 
.., s-1}. To access item x, decrement c(x) by l(mod s). If c(x) e S, move x 
to front. 

— RST(s,D) : For each x, maintain a mod-s counter c(x) G {0, 1, s-1} set 
randomly with probability D(i). For accessing item x, decrement c(x) by 
l(mod s). Then if c(x) = 0, move x to the front and randomly reset c(x) 
using D. 

— TS(p) : For accessing item x, with probability p execute (i) move x to the 
front; and with probability 1-p execute (ii).(ii) let y be the first item in the 
list such that either (a) y was not requested since the last request for x or 
(b) y was requested exactly once since the last request for x and that request 
for y was served by the algorithm using step (ii). Insert x just in front of y. 
Do nothing, if there is no such y or this is the first request to x.[?]. 

— COMB : Before serving any request, choose algorithm BIT with probability 
4/5 and algorithm TS with Probability 1/5. Serve the entire request sequence 
with the chosen algorithms. 

Research Issues : 

— Close or diminish the gap of [1.5, 1.6] in competitive ratio for the randomized 
online algorithms against oblivious adversary. 

— Determine the competitive ratio of RMTFp for each p € (0,1). 

— Close or diminish the gap of [1.625, 1.75] for the BIT algorithm. 
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Algorithm 


Result 


Researcher (s) 




Lower Bound: 1.18 


Karp, Raghavan [1990] 


SPLIT 


CR : 1.875 


Iranip] [1991] 




1.5 : Lower Bound 


Teia[?] [1993] 


BIT 


CR : 1.75 


Reingold, Westbrook, Sleator[?][1994] 


RST(s, D) 


CR : 1.732 




TS(p) 


1.62-competitive 


Albers[?] [1995] 


COMB 


CR : 1.6 : Best Upper bound 


Albcrs, Von stongol, Wcrchncr[?] [1995] 


COUNTER 


CR : 85/49 


Albcrs, Mitzenmaclier[?] [1997] 


RMTF 


CR : > 2 


Garefalakis[?] [1997] 




Stronger Lower Bound : 1.5 


Hagerup[?] [2007] 



Table 2 : Competitiveness of Randomized Online algorithms 



5 List Update with Look Ahead 

In the list update problem with look ahead, the online algorithm knows some 
future requests in th e form of blocks of requests of variable size. Albers[1998] 
studied the influence of look ahead in the list update problem and introduced 
two different models of look ahead such as - weak look ahead and strong look 
ahead [?]. 

Weak look ahead: In this model, the online algorithm knows the present 
request and next 1 future requests. When processing a{t), online algorithm only 
knows cr(t+l), f7(t+2), a{t+l) but does not know a{s) such that s > t+1+1. 
Strong look ahead : In this model, the online algorithm knows the present 
request and a sequence of future requests which contains 1 pairwise distinct items 
which differ from the present requested item. 



Model 


Lower Bound 


Upper Bound 


Strong look ahead 


2-(l+2)/(n+l) 


2-(2/3)(l+2)/(2n-l) 


Weak Look ahead 


2- 2y/{4K^2K)+ 4K 





Table 3 : Summary of Competitiveness Results 



Research Issues 

— Develop some alternate model for look ahead other than weak and strong 
model for analysis. 

— Design of semi-online algorithm for varying size of the look ahead. 

— Design and analysis of randomized online algorithm for LUP with strong 
and weak look ahead. 

— Design of online algorithms that are competitive against dynamic off-line 
algorithms. 

— Design of deterministic online algorithms for n-element list with k-lookahead 

problem. 

— Tighten the gap between upper and lower bounds in the weak and strong 
look ahead model. 



8 Rakesh Mohanty and N. S. Narayanaswamy 

6 List Update with Locality of Reference : 

A study of locality of reference in list update was initiated by Angclcpoulos et 
al. [?], where they adapted a locality model introduced for the paging problem 
and proved that MTF is superior to other algorithms. A comprehensive study 
of list update with locality of reference was presented recently by Albers and 
Lauer[?]. Their theoretical and experimental work provided a refined analysis of 
the problem with a new model based on the concept of runs in which theoretical 
and empirical results match or nearly match. 

Research Issues : 

— Theoretical and experimental study of online algorithms list update with 
locality of reference. 

— Developing a new cost model to capture the locality of reference in LUP. 

— Developing improved online algorithm for list update with locality of refer- 
ence. 

7 Empirical Studies 

A number of experimental studies have been conducted by various researchers 
on the list update problem. Tannenbaum [1978] tested the performance of var- 
ious algorithms from the MOVE-AHEAD(k) family with respect to request se- 
quences generated by Zipf's law. Bentley and McGeoch[1985] have tested the 
performance of MTF, FC, TRANS with respect to request sequences generated 
from several text files and found that FC is always superior to TRANS and 
MTF is often superior to FC. Albers and Mitzenmacher [1995] have compared 
the compression performance of TS and MTF with respect to Calgary Corpus 
by considering both word and byte parsing scheme. Burrows and Wheeler[1994] 
tested the performance of an MTF compressor via block sorting transformation 
and Grinberg et al.[1995] tested the performance of MTF compressors that uses 
secondary lists. Bachrach and El-Yaniv [1997] have conducted an extensive ex- 
perimental study of a large number of different online list accessing algorithms 
based on access cost performance and compression performance. They consid- 
ered a wide range of request sequences and used an experimental approach to 
examine the influence of locality of reference in request sequences on the per- 
formance of online list accessing algorithms. They showed that the degree of 
locality has a considerable influence on algorithms' cost and their ranking. The 
two extreme cases studied so far concern with the the inputs as an independent 
observations of a probability distribution and the inputs generated by an ad- 
versary aiming to maximize the competitive ratio of the algorithm. Although a 
number of interesting theoretical results have been obtained in the analysis of 
list accessing problem, an experimental feedback could have lead to better and 
more realistic theory [?]. 
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We present below a summary of research work done till date on experimental 
analysis of empirical studies of self orgainizning sequential search algorithms. 



Researcher (s) 


Brief description of Work 


Tenenbaum[1978][?] 


Tested performance of MHD(k) family 

algorithms with respect to request 
sequences distributed by Zipf 's law. 


Bentley, McGeoch[1985][?] 


Tested performance of MTF, FC, TRANS 

with respect to request sequences 
generated from several text files. 


Burrows, Wheeler [1994] 


Tested performance of MTF compressor 

via block sorting transformation. 


Grinberg, Rajagopalan et al.[1995] 


Tested performance of MTF compressors 
that uses secondary lists. 


Albers, Mitzenmacher[1995][?] 


Compared compression performance of TS 
with that of MTF for Calgary Corpus by 
considering word and character parsing. 


Bachrach, El-Yaniv[1997][?] 


Tested performance of deterministic and 
randomized online list accessing algorithms 
with respect to dictionary maintenance and 
compression applications. 


Bachrach, El-Yaniv, Reinstadtler[2002][?] 


Extensive empirical study of a large set 
of online list accessing algorithms including 
MRI and PRI famiUes 



Table 4. A Summary of Experimental Analysis 



Research Issues : 

— Determination of some new alternate metric for measuring the performance 
of list accessing algorithms. 

— Devise a meaningful, quantitative measure of locality of reference that could 
be used to classify request sequences. 

— Design an experimental set up which will cover a wide range of request 
sequences. 

— Investigate the correlation between various algorithms and their performance 
with respect to the request sequences for real life inputs. 

— Design an appropriate corpus for testing the performance of data structures 
and algorithms used for dictionary maintainence. 

— An Experimental study for dynamic transitions between different basic list 
accessing algorithms for adapting to changing levels of locality of reference. 

8 List Update Variants 

8.1 Parallel List Update Problem 

Given a set S of n.m elements arranged in n lists Li, L21 Ln of m elements 
each, with m > n and a sequence of requests a = Ri, R2, Rn, where each 
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request i?i C S is a set of n elements. Goal is to search the elements of each 
Ri in parallel and then update the lists in order to process cr efficiently. Luccio 
and Pedrotti in 1994 [?] have proposed (n^+l)-competitive algorithm against 
a static optimal algorithm with a lower bound of 2n. They also developed a 
randomized algorithm with a competitive factor of (9/2)n against an oblivious 
adversary with a lower bound of (3/2)n. 

8.2 Distributed List Update Problem 

Here the list update problem is studied in a distributed environment where the 
set of items is partitioned across 2 processors and in which the cost of accessing an 
item is a combination of a list searching cost and a communication cost. Shende 
and Simha in 1995 [?] have studied the distributed list update problem under 
2 models. In the Global Knowledge model, the algorithm knows the partition 
of items in advance, while in the Local Knowledge model, the algorithm has no 
knowledge regarding the partition of items. They have proved that Distributed 
Move-To-Pront(DMTF) is not competitive in Local Knowledge model and 4- 
competitive in case of Global Knowledge model. 

8.3 Relaxed List Update Problem 

Relaxed List Update Problem(RLUP) is a variant of LUP, in which cost to 
access the jth item Xj is cj where Ci < q+i for all i. After accessing, Xj can be 
repeatedly swapped at no cost, with any item that precedes it in the list. This 
problem was introduced by Agrawal et al.[1987] as a model for management 
of hierarchical memory that consists of a number of caches of increasing size 
and access time. Chrobak and Noga[1998] have developed an optimal off-line 
algorithm for RLUP and showed a characterization of work functions for RLUP. 
They proved that MTF is optimally competitive for RLUP with any cost function 
and also provided a lower bound on the competitive ratio of online algorithms 
for RLUP. 

9 Off-line List Update 

Off-line algorithms for the list update problem are useful in the study of compet- 
itive online; algorithms. We present below a summary of results for the off-line 
list update problem. 



Complexity Result 


Researcher(s) 


Year 




Manasse, McGeoch, Sleator[?] 


1988 


6i(n2'(l-l)!) 


Rcirigokl, West brook [?] 


1996 


NP-Hard 


Ambuhl[?] 


2000 


6i(n/^l!) 


Pietzrak[?] 


2001 


0(2'l!f(l)-Fm-Fr) 


Hagerup[?] 


2007 



Table 5. Summary of Results of Off-line List Update 
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Research Issues : 

— Finding the best way to rearrange the hst most effectively with optimal cost. 

— Derive a lower bound for computing an optimal solution. 

— Find an alternate reduction technique to prove NP-hardness of off-line list 
update. 

— Design of efficient exact algorithms for list update. 

— Investigation of better optimum off-line algorithms for List Update Problem. 

— New characterization for optimal off-line algorithms. 

— Design of improved approximation algorithms with a bounded approxima- 
tion ratio. 

10 Concluding Remarks 

We present a summary of best known bounds for both deterministic and ran- 
domized online algorithms for list of different sizes for the list update problem 
till date in the following table. 



list size 


Lower Bound 


Upper Bound 


Remarks 


2 


1.125 


1.125 


tight 


3 


1.2 


1.2 


tight 


4 


1.25 


1.33 


gap : 0.08 


5 


1.25 


1.6 


gap: 0.35 


6 


1.28 


1.6 


gap : 0.32 










1 


1.5-2/(1+3) 


1.6 


gap : 0.1 



Table 6. Best Known Bounds for Online List Update 

The goal of future research must be to find improved online algorithms for the 
list update problem by designing some new principle that will lead to better 
results and tighten the currently existing lower and upper bounds 



